Search AI Products and News

In the rapidly evolving podcasting landscape, Podcastle has announced its new AI text-to-speech model, Asyncflow v1.0. This model offers users over 450 different AI voices and provides developers with an API to integrate this text-to-speech functionality directly into their applications. Podcastle founder Arto Yeritsyan stated the company's commitment to developing a text-to-speech solution...

Sesame's newly released Conversational Speech Model (CSM) has recently sparked heated discussions on X, lauded as a voice model that sounds "just like a real person." Its stunning naturalness and emotional expressiveness not only make it indistinguishable from human speech for users, but also claim to have successfully overcome the uncanny valley effect in the field of voice technology. With the spread of demonstration videos and user feedback, CSM is rapidly becoming a leader in AI voice technology.

Recently, Jiyue Xingchen announced the launch of a new member in the Step series model matrix—the Step-1o end-to-end speech model, claimed to be the first trillion-parameter end-to-end speech model in China. The release of this new model marks a significant advancement in the field of speech technology. By utilizing an end-to-end speech solution, it integrates speech understanding and generation, thereby enhancing the IQ and EQ limits of the model and providing a supernatural, high-quality communication experience.

According to media reports, Tan Xu, former Chief Research Manager at Microsoft Research Asia, joined the startup Dark Side of the Moon in August, primarily responsible for developing end-to-end speech models. One important goal after Tan's joining is to create a speech experience similar to GPT-4o for the company. Dark Side of the Moon has not yet responded, but insiders have confirmed Tan's employment, and specific position details have not been finalized. Public information indicates that Tan Xu's research areas include deep learning, language/speech/music processing, and AI content generation, with publications in AI academic conferences.

Westlake Xincheng announces the open-source release of its Westlake-Omni model. As the world's first open-source Chinese emotional end-to-end speech interaction model, Westlake-Omni utilizes discrete representation to unify text and speech modalities, with a particular focus on real-time capabilities, enabling quick responses and providing an almost zero-latency experience.

NVIDIA has collaborated with several universities to introduce NVEagle, a large visual language model capable of chatting using images. NVEagle can analyze image content and provide accurate answers, such as identifying individuals in images, like Jensen Huang. The model significantly enhances the understanding of visual information by transforming images into visual tokens and combining them with text embeddings. In addressing the challenges of high-resolution image processing, the research team has constructed models like Eagle-X5-7B and Eagle-X by exploring various visual encoders and fusion strategies.

The iFlytek Spark Voice Large Model has received a brand new upgrade, introducing a new generation of interactive experience called 'Ultra-Human-Like Interaction'. This upgrade has optimized and enhanced multiple aspects, aiming to provide users with a more natural, smooth, and emotionally rich dialogue experience.

The LSLM full-duplex language model developed in collaboration between Shanghai Jiao Tong University and ByteDance revolutionizes traditional AI assistant interaction by enabling real-time conversation where users can listen while speaking. The core advantage of LSLM lies in its ability to simultaneously process speech input and generate output, significantly enhancing the natural flow of dialogue. By integrating streaming self-supervised learning with a token-based decoder, this model supports real-time speech interaction and performs exceptionally well even in noisy environments. LSLM's mid-term fusion strategy strikes the optimal balance between speech generation and real-time interaction, demonstrating impressive noise resistance.